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Abstract — A game-theoretic approach for studying power 
control in multiple-access networks with transmission delay 
constraints is proposed. A non-cooperative power control game 
is considered in which each user seeks to choose a transmit 
power that maximizes its own utility while satisfying the user's 
delay requirements. The utility function measures the number of 
reliable bits transmitted per joule of energy and the user's delay 
constraint is modeled as an upper bound on the delay outage 
probability. The Nash equilibrium for the proposed game is de- 
rived, and its existence and uniqueness are proved. Using a large- 
system analysis, explicit expressions for the utilities achieved at 
equilibrium are obtained for the matched filter, decorrelating and 
minimum mean square error multiuser detectors. The effects 
of delay constraints on the users' utilities (in bits/ Joule) and 
network capacity (i.e., the maximum number of users that can 
be supported) are quantified. 



I. Introduction 

In wireless networks, power control is used for resource 
allocation and interference management. In multiple-access 
CDMA systems such as the uplink of cdma2000, the purpose 
of power control is for each user terminal to transmit enough 
power so that it can achieve the desired quality of service 
(QoS) without causing unnecessary interference for other users 
in the network. Depending on the particular application, QoS 
can be expressed in terms of throughput, delay, battery life, 
etc. Since in many practical situations, the users' terminals 
are battery-powered, an efficient power management scheme 
is required to prolong the battery life of the terminals. Hence, 
power control plays an even more important role in such 
scenarios. 

Consider a multiple-access DS-CDMA network where each 
user wishes to locally and selfishly choose its transmit power 
so as to maximize its utility and at the same time satisfy 
its delay requirements. The strategy chosen by each user 
affects the performance of other users through multiple-access 
interference. There are several questions to ask concerning this 
interaction. First of all, what is a reasonable choice of a utility 
function that measures energy efficiency and takes into account 
delay constraints? Secondly, given such a utility function, what 
strategy should a user choose in order to maximize its utility? 
If every user in the network selfishly and locally picks its 
utility-maximizing strategy, will there be a stable state at which 
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no user can unilaterally improve its utility (Nash equilibrium)? 
If such an equilibrium exists, will it be unique? What will be 
the effect of delay constraint on the energy efficiency of the 
network? 

Game theory is the natural framework for modeling and 
studying such a power control problem. Recently, there has 
been a great deal of interest in applying game theory to 
resource allocation is wireless networks. Examples of game- 
theoretic approaches to power control are found in [1-8]. 
In [1-5], power control is modeled as a non-cooperative 
game in which users choose their transmit powers in order 
to maximize their utilities. In [8], the authors extend this 
approach to consider a game in which users can choose their 
uplink receivers as well as their transmit powers. All the 
power control games proposed so far assume that the traffic 
is not delay sensitive. Their focus is entirely on the trade-offs 
between throughput and energy consumption without taking 
into account any delay constraints. In this work, we propose 
a non-cooperative power control game that does take into 
account a transmission delay constraint for each user. Our 
focus here is on energy efficiency. Our approach allows us 
to study networks with both delay tolerant and delay sensitive 
traffic/users and quantify the loss in energy efficiency due to 
the presence of users with stringent delay constraints. 

The organization of the paper is as follows. In Section|ll| we 
present the system model and define the users' utility function 
as well as the model used for incorporating delay constraints. 
The proposed power control game is described in Section ITTT1 
and the existence and uniqueness of Nash equilibrium for the 
proposed game is discussed in Section llVl In Section [V] we 
extend the analysis to multi-class networks and derive explicit 
expressions for the utilities achieved at Nash equilibrium. 
Numerical results and conclusions are given in Sections IVII 
and I VIII respectively. 

II. System Model 

We consider a synchronous DS-CDMA network with K 
users and processing gain N (defined as the ratio of symbol 
duration to chip duration). We assume that all K user terminals 
transmit to a receiver at a common concentration point, such 
as a cellular base station or any other network access point. 
The signal received by the uplink receiver (after chip-matched 
filtering) sampled at the chip rate over one symbol duration 
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where p k , h k , b k and are the transmit power, channel 
gain, transmitted bit and spreading sequence of the k th user, 
respectively, and w is the noise vector which is assumed to be 
Gaussian with mean and covariance er 2 I. We assume random 
spreading sequences for all users, i.e., Sfc = -j=[vi...vn) 7 ', 
where the Vi's are independent and identically distributed 
(i.i.d.) random variables taking values in { — 1, +1} with equal 
probabilities. 



A. Utility Function 

To pose the power control problem as a non-cooperative 
game, we first need to define a suitable utility function. It is 
clear that a higher signal to interference plus noise ratio (SIR) 
level at the output of the receiver will result in a lower bit 
error rate and hence higher throughput. However, achieving a 
high SIR level requires the user terminal to transmit at a high 
power which in turn results in low battery life. This tradeoff 
can be quantified (as in [1]) by defining the utility function of 
a user to be the ratio of its throughput to its transmit power, 
i.e., 

/',. 

(2) 
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Throughput is the net number of information bits that are 
transmitted without error per unit time (sometimes referred 
to as goodpuf). It can be expressed as 

T k = ^Rkfhk), (3) 

where L and M are the number of information bits and 
the total number of bits in a packet, respectively. R k and 
7fc are the transmission rate and the SIR for the k th user, 
respectively; and /(7&) is the "efficiency function" which 
is assumed to be increasing and S-shaped (sigmoidal) with 
/(oo) = 1. We also require that /(0) = to ensure that 
u k = when pk — 0. In general, the efficiency function 
depends on the modulation, coding and packet size. A more 
detailed discussion of the efficiency function can be found in 
[8]. Note that for a sigmoidal efficiency function, the utility 
function in (|2) is a quasiconcave function of the user's transmit 
power. The throughput Tk in could also be replaced with 
any increasing concave function such as the Shannon capacity 
formula as long as we make sure that Uk = when pk = 0. 

Based on and (0, the utility function for user k can be 
written as 



Uk 
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For the sake of simplicity, we have assumed that the transmis- 
sion rate is the same for all users, i.e., R\ = ... = Rk = R. 
All the results obtained here can be easily generalized to the 
case of unequal rates. The utility function in ®, which has 
units of bits/Joule, captures very well the tradeoff between 
throughput and battery life and is particularly suitable for 
applications where energy efficiency is crucial. 



B. Delay Constraints 

Let X represent the (random) number of transmissions 
required for a packet to be received without any errors. The 
assumption is that if a packet has one or more errors, it 
will be retransmitted. We also assume that retransmissions are 
independent from each other. It is clear that the transmission 
delay for a packet is directly proportional to X. Therefore, 
any constraint on the transmission delay can be equivalently 
expressed as a constraint on the number of transmissions. 
Assuming that the packet success rate is given by the efficiency 
function /(7) 1 , the probability that exactly m transmissions 
are required for the successful transmission of the packet is 
given by 

\m — 1 



Pr{X = m} = /( 7 ) (1 - /( 7 )) r 



(5) 



and, hence, E{X} = jp^j- We model the delay requirements 
of a particular user (or equivalently traffic type) as a pair 
(D,/3), where 

Pi{X <D}>(3. (6) 

In other words, we would like the number of transmissions to 
be at most D with a probability larger than or equal to (3. For 
example, (2, 0.9), i.e., D = 2 and (3 = 0.9, implies that 90% 
of the time we need at most two transmissions to successfully 
receive a packet. Note that (|6} can equivalently be represented 
as an upper bound on the delay outage probability, i.e., 

Pdelay outage = ^{X > D} < 1 - 0. (7) 

Based on (0, the delay constraint in (|6jl can be expressed 

as 
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Here, we have explicitly shown that r\ is a function of D and (3. 
Since f(j) is an increasing function of 7, we can equivalently 
express (|8j as 

7 > 7, (10) 

where 

7 = /- 1 (j 7 (A/3)). (ID 

Therefore, the delay constraint in translates into a lower 
bound on the SIR. Since different users could have different 
delay requirements, 7 is user dependent. We make this explicit 
by writing 

% = f 1 (Vk) j (12) 
1 

where r\k = 1 — (1 — Pk) ° k ■ A more stringent delay require- 
ment, i.e., a smaller D and/or a larger P, will result in a higher 
value for 7. Without loss of generality, we have assumed that 
all the users in the network have the same efficiency function. 
It is straightforward to relax this assumption. 

'This assumption is valid in many practical systems (see [8] for further 
details). 



III. Power Control Game with Delay Constraints 

We propose a power control game in which each user 
decides how much power to transmit in order to maximize its 
own utility and at the same time satisfy its delay requirements. 
We have shown in Section III-BI that the delay requirements 
of a user translate into a lower bound on the user's output 
SIR. Therefore, each user will seek to maximize its utility 
while satisfying its SIR requirement. This can be captured by 
defining a delay-constrained utility for user k as 

u k if Ik > Ik m ^ 
if 7 fc < Ik ' K ' 

where Uk and jk are given by (0} and H2\ . respectively. 

Let G = [IC, {Ak}, {v,k}} denote the proposed non- 
cooperative game where JC = {1, K}, and Ak — [0, P ma x\, 
which is the strategy set for the k th user. Here, P max is the 
maximum allowed power for transmission. We assume that 
only those users whose delay requirements can be met are 
admitted into the network. For example, for the conventional 
matched filter, this translates into having 
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This assumption makes sense because admitting a user that 
cannot meet its delay requirement only causes unnecessary 
interference for other users. 

The resulting non-cooperative game can be expressed as the 
following maximization problem: 



max Uk for k 

Pk 



1,...,K, 



(14) 



where the pk's are constrained to be non-negative. The above 
maximization can equivalently be written as 



max Uk subject to 7^ > Ik for k = 1, K. 

Pk 



(15) 



(16) 



Let us first solve the above maximization by ignoring the 
constraints on SIR. For all linear receivers, we have 

djk_ _ Tfc 
dpk Pk 

Taking the derivative of Uk with respect to pk and taking 
advantage of dl6l . we obtain 

duk = f'ilk) d-fk _ /(Tfc) = Tfc /'(Tfc) - /(Tfc) 
dpk Pk dpk v\ Pk 
Therefore, the unconstrained utility function for user k is 
maximized when the user's output SIR is equal to 7*, where 
7* is the (positive) solution to 

/(T)=T/'(T)- (17) 

It can be shown that for a sigmoidal efficiency function, 7* 
always exists and is unique. In addition, for all 7^ < 7*, Uk 
is increasing in pk and for all jk > 1*, Uk is decreasing in 
Pk [9]. Therefore, Uk is maximized when user k transmits at 
a power level that achieves 7^ at the output of the uplink 
receiver, where 

7fc = max{7 fc ,7*}. (18) 

In the next section, we investigate the existence and unique- 
ness of Nash equilibrium for our proposed game. 



IV. Nash Equilibrium for the Proposed Game 

The Nash equilibrium for the proposed game is a set 
strategies (power levels) for which no user can unilaterally 
improve its own (delay-constrained) utility function. We now 
state the following proposition. 

Proposition 1: The Nash equilibrium for the non- 
cooperative game G is given by p£ = min{p£, P ma x}, for 
k = 1, • • • ,K, where pt is the transmit power that results 
in an SIR equal to 7* at the output of the receiver with 
7? = max{7t, 7*}. Furthermore, this equilibrium is unique. 

Proof: Based on the arguments presented in Section |0] 
Uk is maximized when the transmit power pk is such that 7^ = 
7? = max{7fc, 7*}. If 7fc cannot be achieved, the user must 
transmit at maximum power level to maximize its utility. Let us 
define pk as the power level for which the output SIR for user 
k is equal to %. Since user k is admitted into the network only 
if it can meet its delay requirements, we have f>k < Pmax- In 
addition, because Uk = for pk < pk, there is no incentive for 
user k to transmit at a power level smaller than pk- Therefore, 
we can restrict the set of strategies for user k to [pk, Pmax]- 
In this interval, Uk = Uk and hence the utility function is 
continuous and quasiconcave. This guarantees existence of a 
Nash equilibrium for the proposed power control game. 

Furthermore, for a sigmoidal efficiency function, 7*, which 
is the (positive) solution of f(j) = 7 /'(t), is unique and as 
a result 7^ is unique for k = 1, 2, K. Because of this and 
the one-to-one correspondence between the transmit power and 
the output SIR, the Nash equilibrium is unique. ■ 

The above proposition suggests that at Nash equilibrium, 
the output SIR for user k is 7^, where 7^ depends on the 
efficiency function through 7* as well as user fc's delay 
constraint through jk- Note that this result does not depend on 
the choice of the receiver and is valid for all linear receivers 
including the matched filter, the decorrelator and the (linear) 
minimum mean square error (MMSE) detector. 

V. Multi-class Networks 

Let us now consider a network with C classes of users. The 
assumption is that all the users in the same class have the same 
delay requirements characterized by the corresponding D and 
(3. Based on Proposition^ at Nash equilibrium, all the users in 
class c will have the same output SIR, 7*( c ) = max{7^ c ', 7*}, 
where = / _1 (?7 < - c - > ). Here, rj^ depends on the delay 
requirements of class c, namely and f3^ c \ through (|9jl. 
The goal is to quantify the effect of delay constraints on the 
energy efficiency of the network or equivalently on the users' 
utilities. 

In order to obtain explicit expressions for the utilities 
achieved at equilibrium, we use a large-system analysis similar 
to the one presented in [10] and [11]. We consider the 
asymptotic case in which K, N — > 00 and |C — > a < 00. This 
allows us to write SIR expressions that are independent of the 
spreading sequences of the users. Let be the number of 
users in class c, and define c^ c ' = UruRr.iV— >oo "Tv - ■ Therefore, 

we have 53 c =i a ^ = a - 

It can be shown that for the matched filter (MF), the 
decorrelator (DE), and the MMSE detector, the minimum 



power required by user k in class c to achieve an output SIR 
equal to 7*( c ) is given by the following equations: 
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for J2 a(c) T (c) < 1,(19) 
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for a < 1, 



(20) 



7* (c) a 2 




l * i - Ec =1 a(c) 



l + 7*(<0 



for V a (c) - 7 . , , < 1.(21) 

i— I 1 -|- <y*(c) 



Note that we have implicitly assumed that P max is sufficiently 
large so that the target SIRs (i.e., 7*( c )'s) can be achieved by 
all users. Furthermore, since 7*( c ) > ^( c ) for c = 1, • • • , C, 

we have Uk = u k = 4jR- 



ttii . Therefore, for the matched 

filter, the decorrelator, and the MMSE detector, the utilities 
achieved at the Nash equilibrium are given by 



«( C ) 
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Fig. 1. Target SIR, 7*, as a Function of /3 for D =1,2, and 3. 

also a reduction in the utilities of other users in the network. 
A stringent delay requirement results in an increase in the 
user's target SIR (remember 7^ = max{7k, 7*}). Since is 
maximum when 7 = 7*, a target SIR larger than 7* results in 
a reduction in the utility of the corresponding user. In addition, 
because of the higher target SIR for this user, other users in the 
network experience a higher level of interference and hence are 
forced to transmit at a higher power which in turn results in a 
reduction in their utilities (except for the decorrelator, in which 
case the multiple-access interference is completely removed). 



for « (c) 7* (c) < 1, (22) Also ' since % > 7* and £ 



,(c) 



a, the presence 



f.DE 



LR 



(c) 1 /(7* (c) ) 

Mrr-" : \ ■ ^ I 7*M 

c 



and 



-MMSE 



for q(c) < !< ( 23 ) 
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for V q (c) - 7 . . , < 1. (24) 
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Note that, based on the above equations, we have 
^mmse > > ^mf_ means that the MMSE reciever 

achieves the highest utility as compared to the decorrelator and 
the matched filter. Also, the network capacity (i.e., the number 
of users that can be admitted into the network) is the highest 
when the MMSE detector is used. For the specific case of no 
delay constraints, 7*( c ) = 7* for all c and J22i — (1241 reduce to 



-j^hlll-a.'y*)^^- for cry* < 1,(25) 
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h% (1 - a) for a < 1, (26) 



and 



mmse LR a ( 7* ^ /(7*) 
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for a- 



1 + 7* 



< 1. (27) 



Comparing J22l >— J24i with < |25i — 1271. we observe that the 
presence of users with stringent delay requirements results 
not only in a reduction in the utilities of those users but 



of delay-constrained users causes a reduction in the system 
capacity (again, except for the decorrelator). Through Q2> - 
(I24> . we have quantified the loss in the utility (in bits/Joule) 
and in network capacity due to users' delay constraints for the 
matched filter, the decorrelator and the MMSE receiver. The 
sensitivity of the loss to the delay parameters (i.e., D and (3) 
depends on the efficiency function, f(j). 

VI. Numerical Results 

Let us consider the uplink of a DS-CDMA system with 
processing gain 100. We assume that each packet contains 
100 bits of information and no overhead (i.e., L = AI = 
100). The transmission rate, R, is 100Kbps and the thermal 
noise power, a 2 , is 5 x lO~ 16 Watts. A useful example for 
the efficiency function is 7(7) = (1 — e r ) M . This serves 
as an approximation to the packet success rate that is very 
reasonable for moderate to large values of M [3]. We use 
this efficiency function for our simulations. Using this, with 
M = 100, the solution to iTTt is 7* = 6.48 = 8.1dB. 

Fig.[^shows the target SIR as a function of (3 for D = 1, 2, 
and 3. It is observed that, as expected, a more stringent delay 
requirement (i.e., a higher j3 and/or a lower D) results in a 
higher target SIR. 

We now consider a network where the users can be divided 
into two classes: delay sensitive (class A) and delay tolerant 
(class B). For users in class A, we choose Da = 1 and 
(3a — 0.99 (i.e., delay sensitive). For users in class B, we 
let Db — 3 and (3b = 0.90 (i.e., delay tolerant). Based on 
these choices, 7^ = 9.6cLB and % — 7* — 8.1dB. Without 
loss of generality and to keep the comparison fair, we also 
assume that all the users are 100 meters away from the uplink 




receiver. The system load is assumed to be a (i.e., ^ = a) 
and we let ua and as represent the load corresponding to 
class A and class B, respectively, with ola + cxb = ot. 

We first consider a lightly loaded network with a = 0.1 
(see Fig. [2j. To demonstrate the performance loss due to the 
presence of users with stringent delay requirements (i.e., class 
A), we plot — and — as a function of the fraction of the load 
corresponding to class A users (i.e., ^sa). Here, ua and ub are 
the utilities of users in class A and class B, respectively, and 
u represents the utility of the users if they all had loose delay 
requirements which means 7^ = 7* for all k. Fig. [2] shows 
the loss for the matched filter, the decorrelator, and the MMSE 
detector. We observe from the figure that for the matched filter 
both classes of users suffer significantly due to the presence 
of delay sensitive traffic. For example, when half of the users 
are delay sensitive, the utilities achieved by class A and class 
B users are, respectively, 50% and 60% of the utilities for the 
case of no delay constraints. For the decorrelator, only class 
A users suffer and the reduction in utility is smaller than that 
of the matched filter. For the MMSE detector, the reduction in 
utility for class A users is similar to that of the decorrelator, 
and the reduction in utility for class B is negligible. 

We repeat the experiment for a highly loaded network with 
a = 0.9 (see Fig. [3}. Since the matched filter cannot handle 
such a significant load, we have shown the plots for the decor- 
relator and MMSE detector only. We observe from Fig.|5]that 
because of the higher system load, the reduction in the utilities 
is more significant for the MMSE detector compared to the 
case of a = 0.1. It should be noted that for the decorrelator 
the reduction in utility of class A users is independent of 
the system load. This is because the decorrelator completely 
removes the multiple-access interference. 

It should be further noted that in Figs. |2] and [5] we have 
only plotted the ratio of the utilities (not the actual values). 
As discussed in Section|V] the achieved utilities for the MMSE 
detector are larger than those of the decorrelator and the 
matched filter. 

VII. Conclusions 

We have proposed a game-theoretic approach for studying 
power control in multiple-access networks with (transmission) 
delay constraints. We have considered a non-cooperative game 



where each user seeks to choose a transmit power that 
maximizes its own utility while satisfying the user's delay 
requirements. The utility function measures the number of 
reliable bits transmitted per joule of energy. We have modeled 
the delay constraint as an upper bound on the delay outage 
probability. We have derived the Nash equilibrium for the 
proposed game and have shown that it is unique. The results 
are applicable to all linear receivers. In addition, we have used 
a large-system analysis to derive explicit expressions for the 
utilities achieved at equilibrium for the matched filter, decorre- 
lator and MMSE detector. The reductions in the users' utilities 
(in bits/Joule) and network capacity due to the presence of 
users with stringent delay constraints have been quantified. 
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